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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
4/26/2006 has been entered. 

Claim Rejections - 35 USC § 101 

2. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 13 is rejected under 35 U.S.C. 101 . The claimed invention is directed to 
non-statutory subject matter. That is, the claims are directed to a program product, 
which is a functional descriptive material per se. 

In this context, "functional descriptive material" consists of data structures and 
computer programs which impart functionality when employed as a computer 
component. Both types of "descriptive material" are nonstatutory when claimed as 
descriptive material per se. Warmerdam, 33 F.3d at 1360, 31 USPQ2d at 1759. When 
functional descriptive material is recorded on some computer-readable medium it 
becomes structurally and functionally interrelated to the medium and will be statutory in 
most cases since use of technology permits the function of the descriptive material to be 
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realized. Compare In re Lowry, 32 F.3d 1579, 1583-84, 32 USPQ2d 1031, 1035 (Fed. 
Cir. 1994) (claim to data structure stored on a computer readable medium that 
increases computer efficiency held statutory) and Warmerdam, 33 F.3d at 1360-61, 31 
USPQ2d at 1759 (claim to computer having a specific data structure stored in memory 
held statutory product-by-process claim) with Warmerdam, 33 F.3d at 1361, 31 
USPQ2d at 1760 (claim to a data structure per se held nonstatutory). 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent 

4. Claims 15-17, 21, 24-26, and 29-31 are rejected under 35 U.S.C. 102(a) as being 
anticipated by Shuji (Japanese Patent Application Publication 2002-077944, herein 
referred to as "Shuji"). 

As per claim 17, Shuji teaches the claimed: 

a pickup device picking up a two dimensional image data of a subject; 

By teaching of objective lens 101 inside a camera 100 (see figure 1 and paragraph 

[0031] of English translation) and by teaching of "the photoed image of two sheets" 

(paragraph [0021] of English translation) where an image sheet is 2 dimensional. 

Shuji teaches the claimed: 

a three dimensional image creation portion obtaining display data for three 
dimensional display, the display data including image data for a right eye 
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and for a left eye, wherein said three dimensional image creation portion 
includes, 

By teaching of : 

It is characterized by consisting of a 3-dimensional scenography 
generation means to give different parallax to each part of a 
photographic subject, and to generate the 3-dimensional scenography of a 
photographic subject, 
(paragraph [0010] of English translation) 

The amount to which the amount which the image the object for right 
eyes which constitutes the binocular vision image displayed on a head- 
mounted display 120, and for left eyes makes shift a pixel from the 
image of Hara to right and left" 

(paragraph [0038] of English translation) 

Here, accordingly to the reference, display data for the left eye and right eye are 
included. 

Shuji teaches the claimed: 

a first data process means for generating three dimensional data derived 
from the two dimensional data; and 

By teaching of: 

It is characterized by consisting of a 3-dimensional scenography 
generation means to give different parallax to each part of a 
photographic subject, and to generate the 3-dimensional scenography 
of a photographic subject, 

(paragraph [0010] of English translation) 

Here, the photographic subject is two-dimensional and then is converted into a three- 
dimensional image. 
Shuji teaches the claimed: 

a second data process means for converting the three dimensional data 
into the image data for the right eye and the image data for the left eye; 



By teaching of: 
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The amount to which the amount which the image the object for right 
eyes which constitutes the binocular vision image displayed on a head- 
mounted display 120, and for left eyes makes shift a pixel from the 
image of Hara to right and left" 

(paragraph [0038] of English translation) 



Shuji teaches the claimed: 

a display unit displaying an image for the three dimensional display based 
on the display data. 

By teaching of: 

the image for right eyes and the image for left eyes are generated by 3- 
dimensional scenography generation equipment 141 based on the 
above-mentioned principle, and those images are displayed on a head- 
mounted display 120. 

(paragraph [0037] of English translation) 



As per claim 15, the reasons and rationale for the rejection of claim 17 is incorporated 
herein. 

Shuji teaches the claimed: 

wherein said parallax information portion calculates said parallax 
information based on the brightness of the image 

By teaching of: 

From a formula, since a known value and Wr are calculated from the 
ratio of the brightness of each pixel of the photoed image of two 
sheets, L1 , L2, and L can acquire the distance R1 to a photographic 
subject 

(paragraph [0021] of English translation) 

It can obtain by generating the image whose watching-with-many-eyes 
image also changed the shift amount according to distance from the 
image of one sheet by the above-mentioned approach, 
(paragraph [0015] of English translation) 
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Here, the parallax information (shift amount) is based upon the distance the 
photographic subject. Further, the distance is determined based on the brightness of 
the image. Thus, the parallax is also based on the brightness of the image. 



As per claim 16, the reasons and rationale for the rejection of claims 15 and 17 are 

incorporated herein. 

Shuji teaches the claimed: 

wherein said parallax information portion calculates said parallax 
information based on the intensity of light reflected from the subject. 

By teaching of: 

What consists of an operation means to compute the distance from the 
luminescence location of each part by the operation based on the ratio 
of the reflectivity of each part to which each reflected light image 

independently photoed with the image pick-up means 
(paragraph [0016] of English translation) 



As per claim 21 , Shuji teaches the claimed: 

21 . (Previously Presented) The mobile equipment of claim 1 7, wherein 
said pickup device is a single pickup device. 

By teaching of objective lens 101 inside one camera 100 (see figure 1 and paragraph 

[0031] of English translation) 



As per claim 24, Shuji teaches the claimed: 

24. (Previously Presented) The mobile equipment of claim 17, further 
comprising a three dimensional shutter button to pick up the two 
dimensional image data, wherein said three dimensional image creation 
portion obtains the display data in response to press of said three 
dimensional shutter button. 
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By teaching of 

The computer 240 in which the image sensor 202 in an endoscope 200 
had the function which controls the function which outputs the signal 
which usually computed and imaged a picture signal and distance 
distribution information based on the image of two sheets photoed through 
the objective lens 201, and the whole endoscope equipment, It usually 
consists of the image and the 3-dimensional scenography generation 
equipment 241 which generates 3-dimensional scenography 
(paragraph [0047] of English translation) 



Here, the shutter button is the control that creates the three dimensional image. 



As per claim 25, Shuji teaches the claimed: 

25. (Previously Presented) The mobile equipment of claim 17, further 
comprising 

a dividing portion for dividing the two dimensional image data picked up by 
said pickup device into a plurality of blocks; and 

a detecting portion for detecting the brightness of each of said plurality of 
blocks, wherein 

said three dimensional image creation portion generates the display data 
in response to the brightness of each of said plurality of blocks. 

By teaching of 

From a formula, since a known value and Wr are calculated from the ratio 
of the brightness of each pixel of the photoed image of two sheets, L1 , 
L2, and L can acquire the distance R1 to a photographic subject, 
(paragraph [0021] of English translation) 

A 3-dimensional scenography generation means is good as what has 
possible changing the magnitude of parallax, and you may also enable 
it to determine the magnitude of parallax further in the image equipment 
by this invention according to the dilation ratio of the image displayed 
on a display means, 
(paragraph [0024] of English translation) 
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Here, the image is divided into a plurality of blocks (pixels) where the brightness is 
detected for each block (because the brightness of each pixel is considered). Further, 
the display creates parallax. Since the parallax is based upon distance to the 
photographed subject (and thus the distance based on the brightness by which this 
distance is calculated from) the display also depends upon the brightness detected. 



As per claim 26, Shuji teaches the claimed: 

26. (Previously Presented) The mobile equipment of claim 17, further 
comprising 

a radiation unit illuminating the subject with light; and 

a detection portion detecting the intensity of the light, 

wherein said three dimensional image creation portion obtains the display 
data in response to the intensity of the light. 

By teaching of 

Mostly light for said distance acquisition means at coincidence from two 
or more luminescence locations where the emission irradiation ranges to 
a photographic subject differ to the image equipment by this invention 
Moreover, the exposure means which can irradiate a photographic 
subject, What consists of an operation means to compute the distance 
from the luminescence location of each part by the operation based on 
the ratio of the reflectivity of each part to which each reflected light 
image independently photoed with the image pick-up means which 
can be photoed independently in the reflected light image from the 
photographic subject by the light from each luminescence location of an 
exposure means corresponds may be used, 
(paragraph [0016] of English translation) 

Here, the reference teaches of a radiation unit (exposure means which can irradiate a 



photographic subject) and teaches of a detecting portion (reflected light photoed and 
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image pick-up means), and teaches of display data in response to the intensity of the 
light by teaching of a distance acquisition means (where the distance is later used to 
create parallax on the display). Further, since the system is considering the reflectivity 
of each part due to emission irradiation this reflectivity is also intensity of the light. 



As per claim 29, the reasons and rationale for the rejection of claim 17 is incorporated 
herein. 



As per claims 30 and 31, Shuji teaches the claimed: 

wherein said parallax information of said subject is determined based on a 
distance between human eyes; 

By teaching of : 

The amount to which the amount which the image the object for right 
eyes which constitutes the binocular vision image displayed on a head- 
mounted display 120, and for left eyes makes shift a pixel from the 
image of Hara to right and left" 

(paragraph [0038] of English translation) 

Here, in order for the pixel shifting between the left and right eye views to occur the 

system would have to have the parallax information based on the distance between 

human eyes (i.e. a standard average distance). Further, Shuji teaches of prior art 

where the claimed limitation is used by teaching of: 

This shows a binocular-vision image by seeing the photograph which is a 
right eye and took the photograph which took the photograph which 
photoed spacing equivalent to the parallax of human being's both 
eyes 

(paragraph [0003] of English translation) 
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Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6, Claims 7-13, 22, 27, and 28 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Shuji in view of Aoki et al. (US Publication 2002/0054032, herein 
referred to as "Aoki"). 

As per claim 7, the reasons and rationale for the rejection of claims 17 and 21 are 

incorporated herein in regards to the claimed "single pickup device". The reasons and 

rationale for the rejection of claim 17 is incorporated herein in regards to the claimed 

"display unit". 

Shuji teaches the claimed: 

a parallax information portion determining parallax information of said 
subject based on a distance between human eyes; 

By teaching of : 

The amount to which the amount which the image the object for right 
eyes which constitutes the binocular vision image displayed on a head- 
mounted display 120, and for left eyes makes shift a pixel from the 
image of Hara to right and left" 

(paragraph [0038] of English translation) 

Here, in order for the pixel shifting between the left and right eye views to occur the 



system would have to have the parallax information based on the distance between 
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human eyes (i.e. a standard average distance). Further, Shuji teaches of prior art 

where the claimed limitation is used by teaching of: 

This shows a binocular-vision image by seeing the photograph which is a 
right eye and took the photograph which took the photograph which 
photoed spacing equivalent to the parallax of human being's both 
eyes 

(paragraph [0003] of English translation) 

Similarly, the present application teaches using a similar technique by teaching of: 

Processor 105 then provides the three dimensional data with parallax 
information (S406). At step S406 processor 105 performs an 
approximate calculation based on a standard distance between 
human both eyes (e.g., approximately 6 cm) 
(pg. 10, lines 9-11 of specification) 

Shuji teaches the claimed: 

a three dimensional image creation portion creating a three dimensional 
image by applying said parallax information to said image; and 

By teaching of: 

It is characterized by consisting of a 3-dimensional scenography 
generation means to give different parallax to each part of a 
photographic subject, and to generate the 3-dimensional scenography of a 
photographic subject, 
(paragraph [0010] of English translation) 

Shuji does not explicitly teach the claimed: 

wherein said three dimensional image creation portion cuts a human face 
out of said image picked up, to obtain a face image 

Aoki teaches the claimed limitation in figures 7A-7C. 

Lastly, the claimed "and provides said face image with said parallax information" can be 
achieved through the combination of Shuji and Aoki where Shuji provides the parallax 
information which can be applied to the face image of Aoki. 
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It would have been obvious to one of ordinary skill in the art to combine Shuji and 
Aoki. Aoki teaches one advantage of the combination by teaching of "a data 
transmission method able to realize communication in a state where eye contact is 
maintained" (paragraph [0015]) where Shuji would benefit from such added functionality 
through entertaining and interesting communication. 

As per claim 8, Shuji teaches the claimed: 

8. (Original) The mobile equipment of claim 7, wherein said pickup device 
is a pickup device for picking up a two dimensional image. 

By teaching of "the photoed image of two sheets" (paragraph [0021] of English 

translation) where an image sheet is 2 dimensional. 

As per claim 9, Shuji does not explicitly teach the claimed: 

9. (Original) The mobile equipment of claim 8, further comprising: 

a communication control portion controlling a communication with another 
device; and 

Aoki teaches the claimed limitation in figure 1 , 22. 

Shuji does not explicitly teach the claimed: 

a transmission and reception portion allowing a call to and from another 
device. 

Aoki teaches the claimed limitation in figure 1 , 25. It would have been obvious to one of 
ordinary skill in the art at the time of invention to use the claimed feature as disclosed in 
Aoki with Shuji. One advantage to such features is the ability to communicate with 
other users effectively. 
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As per claim 10, the reasons and rationale for the rejection of claim 7 is incorporated 

herein. Shuji teaches the claimed: 

and provides said image of the subject and an image included in said 
image picked up other than said particular subject with different parallax 
information, respectively. 

By teaching of: 

It is characterized by consisting of a 3-dimensional scenography 
generation means to give different parallax to each part of a 
photographic subject 

(paragraph [0010] of English translation) 

where Shuji can perform different parallax for the particular subject (a part of the 

photographic subject). 

Shuji does not explicitly teach the claimed: 

wherein said three dimensional image creation portion selects a particular 
subject from said image picked up, to obtain an image of the subject 

Aoki teaches the claimed limitation in figures 7A-7C by teaching of selecting a subject's 

face portion. It would have been obvious to one of ordinary skill in the art at the time of 

invention to use the claimed feature as disclosed in Aoki with Shuji. Aoki teaches one 

advantage of selecting the face portion by teaching of "a data transmission method able 

to realize communication in a state where eye contact is maintained" (paragraph [0015]) 

where selecting the face makes the communication process more realistic through the 

display. 
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As per claims 11-13, these claims are similar in scope to those of claims 8, 9, 7, 
respectively, and are rejected under the same rationale. 



As per claim 22, the reasons and rationale for the rejection of claim 9 is incorporated 
herein. 



As per claim 27, Shuji teaches the claimed: 

said three dimensional image creation portion further includes a selection 
data process means for generating the two dimensional image data of the 
subject in response to the selection. 

By teaching of 

had the function which controls the function which outputs the signal 

which usually computed and imaged a picture signal ... It usually consists 
of the image and the 3-dimensional scenography generation equipment 
241 which generates 3-dimensional scenography 
(paragraph [0047] of English translation) 

Shuji does not explicitly the claimed: 

operation keys for receiving an input for selection of a subject from the 
background in the two dimensional image displayed on said display unit, 
wherein 

Aoki teaches the claimed limitation by teaching of: 

Cut out on the terminal according to the instructions of the user 
(paragraph [0041]) 
(selection of a subject) 

the entire image input from the imaging means, that is, the camera, is 
output for the image on the monitor of user. The user specifies a region of 
the image to cut out that region 
(paragraph [0044]) 
(selection of a subject) 
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Aoki teaches one advantage of using the claimed feature by teaching of "a data 
transmission method able to realize communication in a state where eye contact is 
maintained" (paragraph [0015]) where selecting the image adds more customized 
functionality to the eye contact feature. In addition, the user may find the selection 
process more interesting than using an automated selection process. 

As per claim 28, Shuji does not explicitly teach the claimed: 

28. (Previously Presented) The mobile equipment of claim 27, wherein 
said operation keys receive inputs for the selection of a plurality of 
subjects and said selection data process means generates the two 
dimensional image data for each of the selected subjects. 

Aoki teaches the claimed limitation in figure 1 where a plurality of face images (selected 

subjects) are shown on screen 23. One advantage to using the claimed feature is that 

one can see both yourself and the person you are talking to on the phone at the same 

time. 

7. Claims 18-20 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Shuji in view of Taniguchi et al. (US Patent 6940646, herein referred to as "Taniguchi"). 

As per claim 18, Shuji does not explicitly teach the claimed "switching liquid 
crystal element". Taniguchi teaches the claimed limitation by teaching of "liquid crystal 
shutter" (col 2, line 56) and by teaching of "switching of parallax images" (col 2, line 36). 

Shuji does not explicitly teach the claimed "deflection angle and patterned phase 
difference". Taniguchi teaches the claimed limitations by teaching of "guiding display 
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light" (col 2, line 21), "a phase plate with a phase difference" (col 14, lines 37-38), and 
by teaching of "a checkered pattern" (col 14, line 60). 

Shuji does not explicitly teach the claimed "controlling portion". Taniguchi 
teaches the claimed limitation by teaching of "to control a phase shift state for each 
block" (col 14, lines 37-38). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to combine Shuji and Taniguchi. One advantage to the combination is 
provided by Taniguchi, which teaches of displaying a high resolution stereoscopic 
image without flicker and without special spectacles (col 2, lines 13-16) for parallax 
images for each of the left and right eyes (col 2, line 2). Shuji would benefit from such 
added functionality. 

As per claim 19, Shuji does not explicitly teach the claimed "prevent an image ... 
from passing through the pixels". 

Taniguchi teaches the claimed limitation by teaching of "liquid crystal shutter" (col 
2, line 56) where a shutter would require the use of preventing an image from passing 
for a given time. 

As per claim 20, Shuji does not explicitly teach the claimed "operation keys 
receiving an input, wherein said controlling portion changes the relationship based on 
the input". 

Taniguchi teaches of a "driving device" (pieces 1 1 and 12) and "image forming 
device" (piece 10) in figure 28. Given these teachings, it would have been obvious to 
one of ordinary skill in the art to use the claimed limitation because the operation keys 
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would provide a convenient and readily known way for the user to control the driving 
and image forming device. 



8. Claim 23 is rejected under 35 U.S.C. 103(a) as being unpatentable over Shuji in 
view of Aoki in further view of Tao et al. (US Patent 5818463, herein referred to as 

"Tao"). 

As per claim 23, the reasons and rationale for the rejection of claim 7 is incorporated 

herein in regards to the claimed "extracting a human face image data". 

Shuji does not explicitly teaches the claimed: 

a memory for storing a face geometry model ... wherein said first data 
process means generates the three dimensional data from the human 
face image data based on the face geometry model. 

Tao teaches these claimed limitations by teaching of: 

The viability of this invention has demonstrated by animating the 
quadrangular face model using facial animation parameters for facial 
expression and visual speech, 
(col 5, lines 18-20) 
(face geometry model) 

wireframe synthesizer 212 takes the output of the local memory in a 
mesh encoder 216, decodes it, and generates a reconstructed mesh of 
the object 
(col 4, lines 35-37) 

(memory for storing a face geometry model) 
It would have been obvious to one of ordinary skill in the art to combine Shuji, Aoki, and 
Tao. Tao teaches one advantage of the combination by teaching of "It is an outstanding 
feature of the present invention to provide a compression method for bit-efficient 
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animation of 3D objects" (col 2, lines 52-54) where Aoki would benefit from such added 
functionality. 



Response to Arguments 

9. Applicant's arguments filed 4/26/2006 have been fully considered but they are 
not persuasive. 

Applicant argues that the prior art rejection of Aoki cutting out a face image is improper 
because the parallax information of Imura would not longer be applicable (top of pg. 16 
of remarks) to the system of Aoki. However, these arguments are now moot in view of 
new grounds of rejection. The prior art rejection for this particular features are based 
upon the combination of Shuji and Aoki. 

Applicant further argues Aoki does not even disclose parallax information (towards 
bottom of pg. 17 in remarks). However, these prior art rejections are based upon a 
combination of references. In response to applicant's arguments against the references 
individually, one cannot show nonobviousness by attacking references individually 
where the rejections are based on combinations of references. See In re Keller, 642 
F.2d 413, 208 USPQ 871 (CCPA 1981); In re Merck & Co., 800 F.2d 1091, 231 
USPQ 375 (Fed. Cir. 1986). As elaborated in the present office action, Shuji is relied 
upon for teaching parallax information. 

In addition, applicant makes further arguments in respect to the prior art rejections 
previously presented, however, these arguments are also moot in view of new grounds 
of rejection as presented in this office action. 
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Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Daniel F. Hajnik whose telephone number is (571 ) 272- 
7642. The examiner can normally be reached on Mon-Fri (8:30A-5:00P). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ulka J. Chauhan can be reached on (571) 272-7782. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 



Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



273-8300. 




DFH 




